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PREFACE 


This  report  documents  the  results  of  the  first  phase  of  a 
three-phase  study  to  identify  the  System  Program  Office  (SPO) 
management  information  needs  and  to  define  the  requirements 
for  an  integrated  information  system  within  the  ESD  system 
acquisition  environment.  The  second  and  third  phases  of  this 
project  were  not  accomplished  due  to  the  lack  of  funds. 

Phase  1 was  to  determine  the  management  information  system 
(MIS)  requirements  necessary  to  support  SPO  needs.  Phase  2 
was  to  evaluate  government-owned  MISs  relating  to  satisfying 
those  requirements  identified  in  Phase  1 and  to  determine  if 
the  data  input  requirement  for  the  MIS  can  be  satisfied  from 
a previously  developed  Computer-Aided  Design  and  Specifi- 
cation Tool  (CADSAT)  data  base.  Phase  2 also  was  to 
recommend  whether  or  not  automated  linkage  is  possible 
between  the  MIS  and  CADSAT.  Phase  3 was  to  make 
recommendations  for  the  implementation  of  the  MIS  under 
several  suboptions. 

Since  this  report  is  based  upon  only  the  tasks  accomplished 
during  Phase  1,  the  contents  must  be  evaluated  as  tentative 
results.  The  pursuit  of  the  perceived  needs  of  management 
personnel  documented  in  this  report  may  or  may  not  yield 

ii 


tangible  benefits.  Further  work  is  necessary  in  this  area 
and  should  concentrate  upon  the  purpose  of  existing 
management  information  systems  and  their  application  to  SPO 
needs,  with  an  emphasis  on  new  management  techniques. 
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SECTION  1 


INTRODUCTION 


1.0  Overview 

This  section  presents  the  purpose,  scope  and 
background  associated  with  this  report. 

1.1  Purpose 

The  purpose  of  this  project  has  been  to  evaluate 
ESD  program  office  management-information-system  (HIS)  (1) 
capabilities  and  needs  and  to  define  the  requirements  for  an 
integrated  information  system  for  ESD  program  offices. 

1.2  Scope 


This  project  has  resulted  in  establishing 
requirements  for  an  integrated  ESD  program  office  MIS  which 
can  provide  the  program  director  with  information  concerning 
project  budget  and  expenditures,  schedules,  and  tracking 


(1)  NOTE: Three  abbreviations  are  used  in  this  report  for 
the  program  office  management-information-system.  These  are 
MIS,,  mis,  and  mainsy. 
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capabilities.  The  requirements  definition  of  this  integrated 
MIS  was  developed  using  a computer-aided  analysis  technique, 
and  the  reports  describing  this  integrated  MIS  are  presented 
as  part  of  this  report  (Appendices  4k)  through  8k)). 

1.3  Project  Background 

ESD/TOI  has  been  developing  a set  of  automated 
tools  for  assisting  ESD  program  office  system  acquisitions. 

In  addition,  ESD  staff  offices  and  program  offices  have 
developed  special  purpose  data  base  systems  to  support  their 
particular  system  acquisition  efforts.  The  task  undertaken 
in  this  study  was  to  evaluate  the  technical  nature  of  the 
data  base  management  systems  employed  at  ESD  and  to  determine 
the  functional  requirements  for  an  integrated  MIS  which  could 
be  used  by  a majority  of  ESD  program  offices  for  meeting 
their  management  and  reporting  needs. 

One  point  should  be  remembered  when  reviewing  the 
requirements  definition  of  the  MIS  presented  in  this  study. 
This  report  summarizes  the  MIS  capabilities  envisioned  by  the 
ESD  staff  and  program  office  personnel  interviewed.  The  data 
base  developed  represents  the  definition  of  requirements  that 
the  interviews  revealed.  Although  additional  phases 
associated  with  this  study  were  planned,  they  were  not 
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accomplished  because  of  the  loss  of  ESD/TOI  project  funds 
allocated  to  this  study.  In  particular,  the  MIS  design 
activities  would  have  been  accomplished  in  the  later  phases 
of  the  project.  Therefore,  the  MIS  requirements  identified 
herein  need  additional  review  before  any  design  and 
implementation  can  proceed.  In  essence,  the  MIS  represented 
in  this  technical  report  is  an  "ideal"  concept  as  envisioned 
by  the  ESD  personnel  interviewed  and  as  evaluated  by  the 
study  personnel . 
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SECTION  2 


TECHNICAL  APPROACH 

2.M  Introduction. 

This  section  describes  the  technical  approach 
(Figure  2-1)  used  to  determine  the  management  information 
needs  envisioned  by  several  program  offices  at  ESD. 

The  objective  of  the  effort  has  been  to  identify 
automated  MIS  requirements  which  can  enable  program  offices 
to  maintain  better  cost  and  schedule  control . "Requirements" 
as  used  in  this  report  are  those  specific  capabilities  to  be 
included  in  a system.  These  requirements  can  be  measured  and 
readily  tested.  The  requirements  defined  at  this  stage  are 
"ideal";  additional  effort  is  necessary  to  reduce  the 
requirements  to  those  which  can  be  realistically  implemented. 
An  MIS  is  used  in  this  report  to  mean  any  manual,  semi- 
manual, or  automated  information  processing  activities  in 
support  of  management.  Management  information  covers  a broad 
range  of  areas.  For  the  purpose  of  this  study,  the  focus  was 
on  costs  and  schedules.  A review  of  other  requirements  was 
accomplished  to  determine  the  management  context  in  which 
cost  and  schedule  information  is  being  used. 
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Determine  MIS  Outputs 
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Figure  2-1.  Technical  Approach 


2.1  Determine  Management  Information  System  Outputs 


The  key  to  an  integrated  MIS  is  the  representation 
of  both  technical  and  management  data  in  a common  data  base 
(not  necessarily  a single  physical  data  base) . Technical  and 
management  data  necessary  for  effective  control  of  these 
projects  was  determined  as  a result  of  interviewing  staff  and 
program  offices  at  ESD.  The  outputs  of  any  MIS  that  would 
fulfill  the  needs  of  a user  must  by  necessity  be  a derivative 
of  his  informational  need.  During  the  course  of  this  study, 
ESD/TOI  identified  those  staff  and  program  offices  which  were 
interviewed.  A guideline  for  the  program  office  interviews 
was  prepared  (Appendix  10) , and  four  ESD  program  offices  were 
interviewed.  The  results  of  these  interviews  are  presented 
in  Section  3 and  Appendices  20  and  30  of  this  report. 

2.1.1  Prepare  Staff  and  Program  Office  Interviews 

The  objective  of  the  staff  office  interviews  was  to 
obtain  information  about  ESD  program  offices  in  several 
areas.  The  staff  offices  are  capable  of  identifying  the 
operational  environment  of  the  ESD  program  offices.  Inputs 
from  staff  offices  were  used  to  aid  in  the  program  office 
interviews.  Information  required  from  and  provided  to  the 
program  offices  by  the  staff  offices  was  identified. 
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Since  the  objectives  of  the  staff  and  program 
office  interviews  were  slightly  different,  a somewhat 
different  interviewing  technique  was  used.  While  the  program 
office  interviews  were  more  guided  and  structured,  the  staff 
office  interviews  were  more  informal. 

2.1.2  Interview  Staff  Offices 


Staff  office  interviews  covered  four  general 


questions : 


o What  information  is  required  by  program  offices  in 
reporting  outside  the  program  office? 

o What  information  is  provided  to  the  program 
offices  by  the  staff  offices? 

o What  aid  and  assistance  do  the  staff  offices 
provide  to  the  program  offices? 

o What  areas  of  an  MIS  should  the  study  concentrate 
upon? 


2.1.3  Revise  Program  Office  Questions  and  Prepare  Program 
Office  Briefing 

While  interviewing  the  staff  offices,  the  program 
office  interview  guideline  was  revised  as  new  inputs  were 
obtained.  Approximately  one  week  after  the  end  of  the  staff 
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interviews  a final  draft  of  the  program  office  interview 
guideline  (Appendix  lU)  was  completed.  At  this  time  a 
general  review  meeting  was  scheduled  to  solicit  comments  from 
TO I and  the  staff  offices  interviewed. 

A rough  draft  of  a briefing  to  the  selected  program 
offices  was  prepared  a weeK  preceding  this  review  meeting. 
This  briefing  was  to  explain  the  purpose  and  scope  of  the 
study,  and  how  it  was  being  accomplished.  The  briefing 
concentrated  on  the  program  director's  information 
requirements . 

2.1.4  Interview  Program  Offices 

As  mentioned  previously,  the  emphasis  of  this  study 
was  on  costs  and  schedules.  Therefore,  the  program  office 
interviews  were  organized  to  address  these  two  areas  in 
detail  with  the  program  director  and  his  business  management 
office.  As  a result  of  the  emphasis  on  costs  and  schedules 
the  following  categories  were  identified: 

o Primary  Concerns  - These  concerns  include  costs 
and  schedule  areas  in  which  minimum  automation 
assistance  is  available. 

- Cost 

- Schedules 

- Data  Manaaement 
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- Planning 

o Secondary  Concerns  - These  concerns  include  areas 
where  the  government  has  developed  automated 
capabilities.  However,  these  capabilities  require 
further  development,  application,  training,  and 
organizational  acceptance.  These  secondary  concerns 
impact  several  of  the  primary  concerns  listed  above 
and  have  been  included  in  order  to  aid  in 
understanding  the  primary  concerns,  specifically 
costs  and  schedules. 

- Requirements  Analysis 

- Requirements  Traceability 

- Configuration  Control 

- Clerical  Assistance,  e.g.,  automated 

documentation 


In  the  categories  identified  by  the  program  office  directors, 
two  major  areas  were  investigated: 

o Reports  currently  used 
o Information  desired  but  not  available 

For  those  requirements  identified  other  determinations  were 
made  such  as: 


o Frequency  of  need 

o Current  status  of  capability  (e.g.,  manual  or 
automated) 

o Automation  desirability 
o Use  of  the  information 
o User  of  the  information 
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The  program  office's  business  management  personnel  were 
relied  upon  for  detailed  information  to  assist  in  these 
determinations. 

2.1.5  Review  Government-Owned  MIS  Documentation 

In  parallel  with  the  preparation  for  the  interviews 
and  during  the  interviewing,  documents  of  government-owned 
management  information  systems  were  reviewed.  The  ESD  and 
National  Technical  Information  System  (NTIS)  automated 
libraries  were  searched  on  the  subject  of  management 
information.  The  large  number  of  abstracts  identified  by  the 
search  were  reviewed.  The  relevant  documents  reviewed  are 
listed  in  the  selected  bibliography  (Appendix  90). 

2.2  Determine  MIS  Input 

MIS  inputs  were  defined  which  correlated  with 
output  data  gathered  in  the  interview  task.  Subsequently, 
the  inputs  were  further  broken  down  to  locate  the  specific 
sources  of  their  origin.  At  this  point  in  the  study,  the 
minimization  of  the  quantity  of  input  data  was  not  an 
objective.  Some  reduction  of  the  input  data  was  achieved 
during  the  course  of  the  MIS  requirements  definition. 


Additional  analysis  and  the  reduction  of  the  quantity  of 
input  data  was  planned  for  in  a later  phase  of  this  project 
but  was  not  accomplished  due  to  early  termination  of  this 
study. 

2.3  Define  Functional  Requirements 

The  definition  of  the  functional  requirements  of 
the  MIS  began  by  analyzing  the  results  of  the  E5D  staff  and 
program  office  interviews.  In  analyzing  the  interview  data, 
the  information  system  aspects  required  by  regulations  or 
directives  were  extracted.  In  addition,  those  aspects  which 
the  program  office  directors  believe  are  required  for  the 
effective  program  office  management  and  technical  functions 
were  identified.  Once  all  the  required  and  desired 
management  system  outputs  were  identified,  a computer  data 
base  description  of  each  output  was  developed.  As  a separate 
task,  the  information  which  the  program  offices  receive 
(inputs)  was  identified  and  a data  base  definition  of  each 
input  was  also  developed.  The  relationships  between  the 
outputs  and  inputs  was  not  a primary  consideration.  At  this 
point  in  the  study,  it  was  the  intent  to  define  these 
independently.  The  next  step  was  to  define  the  high-level 
functions  which  link  the  inputs  and  the  outputs  together. 
These  functions  and  the  input/output  definitions  at  this 


stage  were  characteristically  high  level  functional 
requirements  and  represented  the  high  level  relationships 
without  consideration  or  emphasis  on  implementation  aspects. 
In  essence,  the  data  base  definition  represented  only  the 
global  functional  requirements  of  the  MIS.  This  approach 
provided  the  means  of  generating  a definition  of  the  MIS 
requirements  as  revealed  by  the  interview  and  analysis 
activities  without  being  troubled  with  the  problems  of 
inconsistencies  and  incompleteness.  More  importantly, 
however,  the  data  base  represented  a complete  repository  of 
all  the  information  identified  or  associated  with  the  MIS  as 
a result  of  the  interviews  and  subsequent  analysis. 

At  this  point  in  the  study,  the  process  of  reducing 
the  global  aspects  of  this  MIS  definition  could  proceed.  The 
clarification  of  the  requirements  proceeded  in  an  iterative 
manner.  As  more  refinements  were  generated,  the  data  base 
definitions  were  corrected,  and  the  impacts  on  other  aspects 
of  the  MIS  were  determined  and  refined.  At  the  conclusion  of 
the  initial  phase  of  this  study,  and  as  represented  in  this 
report,  the  definition  of  the  MIS  requirements  represents  a 
range  of  detailed  information  from  high-level  global  aspects 
to  intermediate  and  lower-level  functional  requirements. 

This  refinement  process  was  a continuing  aspect  of  this  phase 
of  the  study,  and  it  was  an  aspect  that  would  have  continued 
into  the  later  phases  of  this  project. 
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SECTION  3 


SUMMARY  OF  ESD  INTERVIEWS 


3.»  Introduction 

During  tne  course  of  this  project,  discussions  were 
held  with  several  ESD  staff  and  program  offices  to  identify 
the  management  information  requirements  which  each  of  these 
offices  believe  need  improvement.  Discussions  were  held  with 
two  ESD  staff  offices  (the  Directorate  of  Acquisition 
Support,  and  Technical  Integration  Division  (TOST) ) and  four 
divisions  within  the  Comptroller's  Office  (AC).  Four  program 
offices  were  also  interviewed.  They  were  OCn/TRACALS, 
OCL/PAVE  PAWS,  DC V/SATIN  IV,  and  YW/E-3A  (AWACS) . This 
section  summarizes  the  findings  of  these  separate  interviews. 
A complete  description  of  the  interviews  is  presented  in 
Appendices  2k)  and  3m  of  this  report. 

3.1  TOST  Interviews 

TOST  emphasized  the  need  for  standardization  of  the 
information  exchanged  between  all  agencies  and  commands 
involved  in  the  acquisition  process.  Although  liaison 
personnel  have  proven  to  be  useful  conduits  for  intra-command 
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communications,  the  exchange  of  information  across  commands 
and  agency  lines  needs  improvement  by  standardization  of 
terminology. 


From  TOST  s point  of  view  the  information  areas  of 
special  concern  are  as  follows: 


o Standardization  of  terminology.  Automated  Data 
Processing  data  elements  and  computer  programs  for 
similar  systems  in  order  to  enable  collection  and 
comparison  of  cost/schedule  data. 

o Common  hierarchies  for  operational  requirements, 
system  hardware/parts,  system  software  (Computer 
Program  Configuration  Items) , functional  specialties 
(Work  Breakdown  Structure,  engineering  specification 
trees,  configuration/engineering  change  proposal 
accounting,  work  unit  codes,  parts  breakdown  and 
provisioning  lists) . 

o Development  of  efficient,  user-oriented  optimum 
repair  level  analysis  and  logistics  support  analysis 
computer  programs 

o Development  of  realistic  life-cycle-cost  models 


3.2  AC  Interviews 

The  concerns  of  the  four  offices  interviewed  within 
the  Comptroller's  Office  are  similar.  Therefore,  the  results 
of  these  interviews  are  presented  collectively  for  AC  rather 
than  individually.  From  AC's  point  of  view  the  specific 
management  information  concerns  for  program  offices  are 
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estimating,  scheduling,  budgeting,  planning,  analyzing,  and 
forecasting • 

First,  the  schedule  and  cost  estimating  process 
should  be  standardized.  A single  methodology  applied  to  each 
program  office  can  provide  a savings  in  the  manpower  required 
to  generate  the  estimates,  decrease  the  workload  of  the  staff 
office,  and  provide  for  a better  understanding  between  the 
program  office  and  the  staff  personnel.  The  development  of  a 
single  methodology  facilitates  feedback  leading  to 
refinements  which  will  increase  budgeting  accuracy. 

Second,  determination  of  tasking  and  manpower 
requirements  is  manually  accomplished  and  needs  improved 
methods. 


Third,  detailed  budgeting  methods  for  annual 
budget  submissions  need  to  be  developed,  and  the  budgeting 
process  performed  by  the  staff  and  program  office  needs 
further  definition  and  improvement. 

Fourth,  not  only  does  the  program  office  need  the 
assistance  of  computer-aided  tools  in  the  preparation  of 
various  plans  and  documents,  but  there  is  also  a real  need 
for  identifying  the  inconsistencies  between  various  planning 
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activities.  The  development  of  the  project  planning 
information  should  allow  for  an  interface  between  planning 
activities,  as  well  as  provide  the  ability  to  determine  the 
impact  of  system  requirement  changes  (e.g.,  on  budgets  and 
schedules) . 

Fifth,  the  program  office  should  be  able  to 
communicate  progress  to  external  agencies  or  other  commands. 

Finally,  the  program  office  should  be  able  to 
project  future  problems  (e.g.,  in  schedule  and  cost)  in 
order  to  make  necessary  adjustments. 

3.3  BSD  Program  Office  Interviews 


Four  ESD  program  offices  were  interviewed  during 
the  course  of  this  project.  They  were  OCN/TRACALS , OCL/PAVE 
PAWS,  DCV/SATIN  IV,  and  YW/E-3A.  Each  of  these  program 
offices  identified  two  primary  areas  of  concern:  timeliness 
of  cost  data  received  from  the  contractor,  and  processing 
engineering  change  proposals  (ECPs). 


First,  the  cost  data  available  from  contractors 
through  CPRs,  CSSRs,  and  CFSRs  does  not  satisfy  the  program 
office's  informational  needs  nor  the  requirements  to  report 
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progress  to  higher  command  levels.  In  most  cases  this  data 
lags  weeks  behind  the  real  events.  A more  timely  means  of 
transmission  and  evaluation  of  contractor  cost  data  is 
needed . 


Second,  ECP  review  consumes  a considerable  amount 
of  program  office  human  resources.  The  number  of  ECPs  being 
processed  is  increasing  in  the  program  offices  interviewed; 
however,  the  methods  employed  in  the  review  process  are 
primarily  manual.  The  ability  to  track  the  ECP  process  and 
to  evaluate  an  ECP's  impact  on  the  established  requirements 
of  the  system,  as  well  as  on  cost  and  schedule,  were 
identified  as  primary  concerns.  Automation  was  viewed  as 
highly  desirable. 

Finally,  one  program  office  (QCN)  identified  the 
need  for  the  ability  to  produce  contract  documents 
(Statements  of  Work,  and  Specifications)  in  a more  methodical 
fashion.  Information  system  assistance  in  this  area  has  been 
accomplished  in  some  ESD  program  offices,  but  has  not  been 
addressed  on  a more  global  basis  within  ESD.  This  need  is 
more  apparent  in  basket  program  offices  such  as  OCN,  where 
more  than  one  system  specification  and  statement  of  work  is 
being  developed  at  a given  time.  However,  the  need  is 
apparent  in  all  program  offices  when  the  development  of  a 
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specification  or  statement  of  work  is  initiated.  At  this 
time,  each  ESD  program  office  proceeds  with  the  RFP 
preparation  by  a manual  process  which  requires  attention  to 
numerous  contracting  regulations  at  the  same  time  the  program 
office  is  attempting  to  finalize  the  user's  requirements. 
Assistance  in  requirements  definition  and  contract  document 
preparation  was  identified  as  being  an  area  where  information 
processing  can  make  significant  contributions  to  the  ESD 
acquisition  process. 
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SEC 11 UN  4 


DISCUSSION  OF  MIS  REQUIREMENTS 

4.  id  Introduction 

This  section  presents  the  functional  requirements 
of  an  integrated  MIS  for  the  control  of  technical  and 
management  data  within  an  ESD  program  office.  The  MIS 
requirements  were  developed  using  a computer-aided  analysis 
tool.  In  order  to  facilitate  the  understanding  of  the  MIS 
requirements  produced  by  this  analysis  tool,  this  section 
begins  with  a brief  description  of  the  tool  and  its 
report-generation  capabilities.  Once  these  general  concepts 
have  been  introduced,  the  actual  MIS  requirements  are 
presented  in  a series  of  computer-generated  reports  with 
supporting  text. 

4.1  CADSAT  Overview 

The  MIS  requirements  associated  with  this  study 
were  defined  and  analyzed  by  project  personnel  employing  a 
computer-aided  analysis  tool  called  Logicon  Extended  CADSAT 
(Computer-Aided  Design  Specification  and  Analysis  Tool). 
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CADSAT  is  a large  computer  program  package  which  has  evolved 
from  university  research  (1)  concentrating  on  developing  a 
means  for  describing  information  processing  systems  and  for 
recording  and  analyzing  the  descriptions  in  a machine 
processable  form.  In  1973  ESD/TOI  initiated  an  advanced 
development  project  to  acquire  a computer  assisted 
requirements  analysis  capability  which  would  facilitate  the 
system  requirements  definition  activities  in  ESC  system 
program  offices.  CADSAT  was  acquired  as  a result  of  the 
ESD/TOI  advanced  development  project  and  has  been  used 
experimentally  in  several  ESD  program  offices,  most  notably 
the  Joint  Surveillance  System  (JSS)  program  office.  CADSAT 
was  used  during  the  course  of  this  project  to  define: 

o the  functions  of  the  MIS 

o the  quantities  of  data  flowing  into,  within,  and 
out  of  the  MIS 

o the  interface  points  between  the  MIS  and  its 
environment 

o the  attributes  (values)  of  the  MIS  functions, 
interfaces,  and  data 


(1)  University  of  Michigan  has  developed  software  under 
ESD/TOI  contract  F19628-76-C-4) 197  to  support  CADSAT.  Also 
other  related  work  is  performed  under  the  University  of 
Michigan  ISDOS  Project.  The  extended  version  used  in  this 
project  is  a modification  developed  by  Logicon  under  ESD/OCU 
contract  F19628-76-C-0218  to  facilitate  applications  to  large 
military  systems. 
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The  MIS  requirements  were  not  entered  directly  into 
the  computer  in  their  original  conceptual  form.  CADSAT 
requires  that  the  functional  requirements  entered  into  CADSAT 
computer  files  be  organized  into  a hierarchical  model 
representing  the  top  down  functional  breakout  of  the  system 
being  defined.  The  methodology  associated  with  CADSAT 
further  requires  the  generation  of  unique  names  for  each 
function  m the  model.  In  addition,  the  data  flowing  into, 
within,  and  out  of  the  MIS  being  defined  must  be  explicitly 
identified.  Once  the  MIS  model  was  determined,  it  was 
entered  into  CADSAT  computer  files  by  following  prescribed 
format  conventions  and  by  typing  the  information  into 
computer  files  via  interactive  communication  terminals.  The 
MIS  requirements  files  were  then  utilized  by  other  CADSAT 
computer  programs  which  analyzed  the  requirements  definition 
and  generated  various  reports.  The  process  of  CADSAT  report 
generation,  review/analysis,  and  updating  the  computer 
requirements  definition  data  base  continued  for  several 
iterations.  This  methodology  provided  for  visibility  into 
the  MIS  definition. 

CADSAT  provides  a means  of  describing  information 
system  requirements  by  the  identification  of  a number  of 
types  of  objects  and  the  relationships  between  them.  Objects 
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which  are  involved  in  creating,  storing,  or  using  the 
information  from  the  MIS  are  identified  (INTERFACES  or  REAL 
WORLD  ENTITIES) . The  physical  units  by  which  data  enters  or 
leaves  the  MIS  are  identified  (INPUTS  and  OUTPUTS).  Units  of 
data  are  described  (SETS,  ENTITIES,  GROUPS,  and  ELEMENTS) 
followed  by  the  functions  (PROCESSES)  which  operate  on  the 
data.  The  dynamic  aspects  of  the  MIS  are  described  by 
stating  the  conditions  which  trigger  events  over  time  and  the 
activities  which  result  from  the  events  (CONDITIONS  and 
EVENTS) . Finally,  the  size  of  the  MIS  is  described  by 
stating  the  parameters  which  define  size  (System  Parameters) . 
Each  of  these  aspects  is  more  fully  described  in  the 
following  paragraph. 


The  CADSAT  MIS  requirements  definition  includes 
three  basic  components  as  illustrated  in  Figure  4-1.  These 
are  the  MIS  PROCESS  structure,  MIS  data  structures,  and  the 
relationships  between  the  MIS  PROCESSES  and  data. 

First,  the  MIS  functions  (1)  are  organized  in  a 
top-down  hierarchical  manner.  That  is,  the  top  function 
(PROCESS)  is  the  management-information-system.  Under  this 
PROCESS  are  other  PROCESSES.  The  hierarchical  breakout  of 
PROCESSES  (process  structure)  continues  for  as  many  other 
additional  lower  PROCESS  levels  until  the  functions  of  the 

(1)  Note:  For  the  purpose  of  this  study,  CADSAT  PROCESSES 
are  equivalent  to  MIS  functions 
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Each  MIS  PROCESS  is 


MIS  are  completely  identified, 
identified  by  a unique  name  which  can  be  associated  with  the 
functions  performed  by  the  PROCESS. 

Second,  data  flowing  into,  within,  or  out  of  the 
MIS  is  also  organized  into  hierarchical  structures  as 
diagrammed  in  Figure  4-1.  Data  flowing  into  the  MIS  from  the 
environment  (everything  that  is  not  part  of  the  MIS  defined 
requirements)  enters  the  MIS  from  an  INTERFACE  as  an  INPUT. 

As  shown,  INPUTS  are  collections  of  stored  data  and  may  be 
hierarchically  related  to  a larger  collection  of  data  called 
a SET  or  to  two  smaller  collections  of  data  called  GROUPS  and 
ELEMENTS.  Data  flowing  out  of  the  MIS  into  the  environment 
exits  to  an  INTERFACE  as  an  OUTPUT.  OUTPUTS  are 
hierarchically  organized  in  the  same  manner  as  INPUTS.  An 
ENTITY  is  a term  used  to  refer  to  collections  of  data 
internal  to  the  MIS.  As  with  INPUTS  and  OUTPUTS,  ENTITIES 
can  be  organized  into  larger  collections  of  data  called  SETS 
or  represented  by  two  lower  collections  of  data,  GROUPS  and 
ELEMENTS.  Three  points  should  be  remembered  relative  to  the 
INPUT,  OUTPUT,  and  ENTITY  data  collections.  One,  higher 
level  collections  of  data  are  generally  associated  with  files 
and  physical  storage  devices  while  GROUP  and  ELEMENT  data 
represent  items  with  actual  informational  values.  Two,  the 
definition  of  the  functional  requirements  of  the  data 
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structures  (also  process  structure)  proceeds  from  the  top  of 
the  hierarchy  structure  and  continues  down  until  the  level  of 
detail  satisfies  the  known  requirements  of  the  MIS.  That  is, 
some  branches  of  these  structures  will  naturally  extend 
beyond  the  level  of  detail  of  other  branches  in  the  same 
structure  as  the  definition  of  the  MIS  requirements  are 
identified  and  entered  into  the  computer  files.  Third,  the 
relationship  between  higher  levels  of  PROCESSES  more  directly 
corresponds  to  the  higher  levels  of  the  data  structures. 

Finally,  the  third  component  of  the  CADSAT  MIS 
requirements  definition  includes  information  which  describes 
the  relationships  between  the  PROCESSES  in  the  process 
structure  and  the  various  data  sublevels  contained  in  the 
input,  output,  and  comprehensive-data-base  SETS  of  the  MIS. 
These  relationships  include  linking  the  PROCESSES  which 
receive/generate  the  information  to  INPUTS/OUTPUTS  or 
internal  units  of  information.  This  effectively  defines  the 
data  flowing  into,  within,  and  out  of  the  MIS  as  illustrated 
in  Figure  4-1.  In  addition  the  dynamic  behavior  of  the  MIS 
is  described  by  identifying  the  conditions  or  situations 
which  trigger  events  and  the  actions  which  result  in  the 
events.  Further  MIS  descriptions  are  included  to  define 
various  MIS  parameters  such  as  size  and  other  quantities  or 
qualities  of  the  MIS. 
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4.2  Overview  of  CADSAT  Report  Formats 


This  section  describes  five  different  types  of 
CADSAT  report  formats.  This  description  will  facilitate  the 
understanding  of  the  specific  CADSAT  MIS  reports  at  the 
conclusion  of  this  section.  Although  the  reports  themselves 
appear  to  be  complex  in  nature,  they  present  the  MIS 
requirements  in  a manner  which  illustrates  the  data  base  in  a 
human  readable  format.  The  five  types  of  reports  selected 
are  the  Process  Structure  Report,  the  Formatted  Problem 
Statement  Report,  the  Contents  Report,  the  Data  Process 
Report,  and  the  Name  List  Report.  Each  of  these  reports  will 
be  described  in  general  terms  in  the  following  subsections. 
These  descriptions  provide  a brief  but  detailed  understanding 
of  each  report  format;  however,  the  reader,  who  desires  only 
an  overview  of  the  MIS  reports  contained  in  this  study,  is 
encouraged  to  skip  this  technical  discussion  and  proceed  to 
section  4.3  where  the  specific  reports  describing  the  MIS  are 
presented. 

4.2.1  Process  Structure  Report 

The  purpose  of  the  process  structure  report  is  to 
present  the  hierarchy  of  PROCESSES  (functions)  defined  in  the 
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MIS. 


MIS.  This  report  format  is  an  aid  to  analysts  in  maintaining 
consistency  in  the  MIS  process  structure  using  the  CADSAT 
methodology.  Since  the  MIS  process  structure  is  defined  in  a 
top  down  approach,  the  project  analyst  can  review  the  process 
structure  report  to  determine  that  all  the  PROCESSES  have 
been  defined,  named  correctly  and  inserted  into  the 
hierarchical  breakdown  at  the  proper  level.  The  process 
structure  report  presents  the  process  structure  under  three 
headings:  COUNT,  LEVEL,  and  NAME.  NAME  presents  the  name  of 
the  PROCESS  in  the  structure,  LEVEL  presents  the  level  number 
associated  in  the  name  corresponding  to  its  position  in  the 
process  structure,  and  COUNT  presents  the  position  (line)  in 
the  report  where  the  PROCESS  name  is  printed  out.  Each  level 
is  indented  to  further  accent  the  idea  of  a hierarchical 
breakout  of  the  MIS.  A summary  section  for  the  report 
provides  a count  (under  the  COUNT  heading)  of  the  number  of 
names  presented  at  a given  level  (as  designated  by  the  LEVEL 
heading ) . 

4.2.2  Formatted  Problem  Statement  Report 

The  purpose  of  the  formatted  problem  statement  is 
to  present  all  descriptive  information  about  any  one  or  more 
names  in  the  MIS  requirements  data  base.  This  report 
presents  all  information  available  for  all  selected  PROCESS 
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names  in  the  data  base  and  its  relationships  with  other 
objects  in  the  data  base.  The  format  of  this  report  is 
easily  understood  by  observing  those  included  in  Appendix  50. 
A formatted  problem  statement  of  all  MIS  names  effectively 
gives  a complete  output  of  the  MIS  requirements  data  base. 

4.2.3  Contents  Report 

The  purpose  of  the  contents  report  is  to  allow  the 
analysts  to  view  the  entire  data  structures  (all  levels) 
described  in  the  CADSAT  MIS  requirements  definition  data 
base.  The  contents  report  presents  a hierarchical  breakout 
of  all  levels  of  data  below  selected  data  types  (ENTITIES, 
INPUTS,  OUTPUTS,  SETS) . All  names  which  these  types  consists 
of  are  designated  as  level  2 names.  This  hierarchical 
breakout  continues  to  all  sublevels  until  the  data  structure 
of  the  selected  data  types  are  completely  presented.  Each 
name  of  the  selected  data  type  is  identified  by  a number  (1*, 
2* , etc.)  designating  its  position  in  the  hierarchical  list. 

4.2.4  Data  Process  Report 

The  purpose  of  the  data  process  report  is  to  show 
the  interaction  between  MIS  information  ( data  - SETS, 
INPUTS,  OUTPUTS,  ENTITIES,  GROUPS,  ELEMENTS)  defined  and  the 
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MIS  PROCESSES.  The  report  also  shows  the  data  dependencies 
among  MIS  PROCESSES  and  possible  deficiencies  in  the 
descriptions  of  the  MIS  PROCESS.  The  data  process  report 
generated  for  this  study  presents  all  the  data  required  for 
each  particular  MIS  PROCESS.  This  form  of  data  process 
report  aids  in  identifying  PROCESS  names  which  do  not 
interact  with  data  or  are  not  consistently  defined  with 
respect  to  the  manner  in  which  they  use  data.  The  data 
process  report  focuses  on  two  matrices  generated  by  CADSAT 
using  the  MIS  requirements  definition  in  the  computer. 

The  first  matrix  (data  process  interaction  matrix) 
shows  the  relationships  between  data  types  (SETS,  INPUTS, 
OUTPUTS,  ENTITIES,  GROUPS,  ELEMENTS)  on  the  left  hand  edge  of 
the  matrix  (rows)  and  the  MIS  PROCESSES  which  are  itemized 
across  the  top  of  the  matrix  (columns)  . The  relationship  of 
a data  type  to  a PROCESS  is  identified  in  the  matrix  by  an 
entry  value  (r,  u,  d,  a,  f,  1,  or  2)  at  the  intersection  of  a 
row  and  column.  The  legend  of  these  entry  values  is  included 
in  the  report  listing.  The  second  matrix  (data  process 
matrix  (incident))  produced  in  the  data  process  report  shows 
the  relationship  between  each  PROCESS  to  all  other  MIS 
PROCESSES  based  on  the  information  contained  in  the  first 
matrix.  (1)  In  this  square  formatted  matrix  (the  rows  and 

( 1 ) Note:  This  impl ies  that  the  second  matrix  does  not 
indicate  all  the  relationships  between  the  PROCESSES 
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columns  are  numbered  identically  and  represent  the  PROCESSES 
in  the  columns  of  the  first  matrix)  an  asterisk(*)  at  the 
intersection  of  a particular  row  and  column  of  the  matrix 
designates  that  the  PROCESS  represented  by  the  row  derives  or 
updates  some  information  which  is  used  by  the  PROCESS 
represented  in  the  column. 


4.2.5  Name  List  Report 

The  purpose  of  this  report  is  to  present  an 
alphabetized  list  (dictionary)  of  all  names  in  the  MIS 
requirements  data  base.  The  name  type  (ATTRIBUTE, 
ATTRIBUTE-VALUE,  CONDITION,  EVENT,  INTERVAL,  SET,  INPUT, 
OUTPUT,  ENTITY,  GROUP,  ELEMENT,  PROCESS,  INTERFACE,  and 
others)  and  the  synonyms  associated  with  each  name  are 
presented  in  columns  on  the  report.  This  report  format  is 
easily  understood  by  observing  the  name  list  included  in 
Appendix  80. 

4.3  Detailed  CADSAT  Description  of  the  MIS 


The  purpose  of  this  paragraph  is  to  describe  each 
MIS  report  included  in  Appendices  50  through  80.  Since  the 
five  report  types  have  been  described  in  the  preceding 
paragraphs,  the  descriptions  contained  in  the  following 
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paragraphs  wilJ  concentrate  on  certain  key  points  concerning 
the  MIS. 


As  stated  earlier,  the  requirements  definition  of 
the  MIS  presented  in  this  study  and  the  CADSAT-gener ated 
reports  presented  in  the  appendices  should  be  reviewed  with 
the  following  points  in  mind.  This  study  represents  the 
results  of  the  definition  of  the  MIS  capabilities  envisioned 
by  the  ESD  staff  and  program  office  personnel  interviewed. 

The  data  base  developed  represents  the  complete  set  of 
requirements  revealed  by  the  interviews.  The  MIS 

requirements  identified  herein  would  need  additional  review 

/ 

before  any  design  and  implementation  of  a MIS  could  proceed. 
In  essence,  the  MIS  represented  in  the  following  reports 
shows  the  "ideal"  concept  as  envisioned  by  the  personnel 
interviewed  and  as  evaluated  by  study  personnel. 

4.3.1  MIS  Process  Structure  Report 

The  MIS  Process  Structure  (Appendix  40)  represents 
the  hierarchical  breakout  of  all  PROCESSES  (functions)  of  an 
ESD  program  office  MIS.  As  seen  in  this  report,  the  MIS  is 
broken  down  into  three  level  2 PROCESSES:  (count  2) 
user-functions,  (count  45)  operations-support,  and  (count  56) 
mis-maintenance . Each  of  these  level  2 PROCESSES  is  again 
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broken  down  into  more  subprocesses.  Each  subprocess  further 
identifies  the  functions  of  the  PROCESS  immediately  above 
and,  as  stated  earlier,  the  sum  of  the  functions  of  the 
PROCESSES  at  any  level  in  the  process  structure  represents 
the  total  functions  of  the  PROCESS  at  the  next  higher  level. 
For  instance,  the  MIS,  user-functions,  reporting- 
capabilities  are  (count  4)  life-cycle-cost-analysis, 

(count  9)  financial-planning-tracking,  (count  14)  schedule- 
pi  anning-and-tr  acking  , (count  2B)  requirements-analysis, 
(count  29)  traceability-analysis,  (count  35)  configuration- 
accounting, (count  36)  ecp-impact-analysis,  (count  37) 
problem-tracking,  and  (count  40)  user-requested-nonstd- 
analyses.  Review  of  the  process  structure  in  conjunction 
with  the  detailed  information  contained  in  the  formatted 
problem  statement  report  (section  4.3.2  and  Appendix  50)  will 
provide  a complete  description  of  each  PROCESS  and  its 
functions . 

4.3.2  MIS  Formatted  Problem  Statement  Report 

As  discussed  earlier,  the  formatted  problem 
statement  report  merely  dumps  all  the  available  information 
on  each  object  desired  in  an  easily  readable  format.  The 
report  included  in  this  study  represents  the  data  known  for 
all  the  MIS  PROCESSES.  For  example,  the  PROCESS  (function) 
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for  the  MIS  can  be  found  between  lines  1 and  11  of  this 
report  (Appendix  50).  This  section  of  the  report  identifies 
the  PROCESS  name  (management-information-system) , synonyms 
(mainsy,  mis),  textual  description,  and  the  subparts 
(PROCESSES  below  the  MIS,  i.e.,  subprocesses).  In  another 
example,  the  probl em-tr acking  PROCESS  section  of  the 
formatted  problem  statement  (lines  393  - 405)  is  linked  to  a 
memo  by  a CADSAT  statement  in  line  40l.  The  actual  memo 
(problem-tracking-examples)  appears  between  lines  416  and 
428.  In  addition,  the  problem-tracking  PROCESS  is  a 
subprocess  to  the  reporting-capabilities  PROCESS  (line  404) 

4.3.3  MIS  Contents  Reports 

A thirty  page  contents  report  has  been  included  in 
this  study.  This  is  the  contents  report  for  the  MIS  selected 
data  types  (ENTITIES , INPUTS,  OUTPUTS,  and  SETS)  as  described 
in  section  4.2.3. 


The  contents  report  included  in  Appendix  60  is 
divided  into  three  SETS:  the  input-set,  output-set,  and 
comprehensive-data-base.  The  MIS  input-set  is  presented  in 
the  first  section  of  the  report  (level  1:  1*,  lines  1 through 
200).  This  section  is  followed  by  the  output-set  (level  1: 
2*,  lines  1 through  577).  The  last  SET  is  the 
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comprehensive-data-base  (level  Is  3*,  lines  1 through  222). 
For  each  of  tnese  three  sections,  the  level  1 data  types  are 
broxen  down  into  additional  levels  (2, 3, 4, 5, 6).  The 
following  example  demonstrates  how  to  read  the  contents 
report.  The  input-set  (1*)  can  be  broken  down  into  ten  level 
2 INPUTS  (lines  1,  55,  100,  132,  151,  167,  184,  198,  199, 

2 00).  The  system-acquisition-plan-init  (INPUT,  line  1)  is 
further  broken  down  into  thirty  (level  3)  groups  and 
elements . 


INPUTS  flow  into  the  MIS  from  the  environment 
(everything  that  is  not  part  of  the  MIS  defined  requirements) 
from  an  INTERFACE . These  MIS  INPUTS  (input-set,  1*)  are 
collections  of  stored  information  which  are  hierarchically 
broken  into  successive  levels  much  like  the  process 
structure . 


The  MIS  OUTPUTS  in  this  report  (output-set,  2*) 
represent  the  information  which  flows  from  the  MIS  to  the 
environment  (to  an  INTERFACE) . MIS  INTERFACES  represent  all 
objects  which  are  involved  in  creating,  storing  or  using  the 
information  flowing  into  or  out  of  the  MIS.  These  may  be 
organizations,  persons,  or  devices  belonging  to  other 
systems. 
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Finally,  the  last  SET  (compr ehensive-data-base , 3*) 
represents  that  information  which  is  entirely  within  the  MIS 


environment.  This  information  is  accessed  by  the  MIS 
PROCESSES  in  accomplishing  its  functions. 

4.3.4  MIS  Data  Process  Report 

As  described  earlier,  the  data  process  report 
represents  the  relationships  of  information  (data)  in  the  MIS 
to  the  MIS  PROCESSES  by  means  of  a matrix  called  the  data 
process  interaction  matrix.  in  addition,  a second  matrix 
contained  in  this  report  (the  process  interaction  matrix 
(incidence))  shows  the  relationship  of  each  MIS  PROCESS  to 
all  other  MIS  PROCESSES.  The  remainder  of  this  section  will 
describe  some  aspects  of  the  two  matrices  contained  in  the 
MIS  data  process  report  (Appendix  70) . 

First,  the  data  process  interaction  matrix 
represents  the  relationships  between  the  MIS  information 
(data  - SETS,  INPUTS,  OUTPUTS,  ENTITIES,  GROUPS,  ELEMENTS) 
defined  and  the  MIS  PROCESSES.  The  side  of  the  matrix  (rows 
or  i)  represents  the  MIS  information  (data) , while  the  top  of 
the  matrix  (columns  or  j)  represents  the  MIS  PROCESSES.  The 
matrix  is  preceded  by  a complete  list  of  row  (data  types)  and 
column  (PROCESSES)  names.  The  relationship  between  each  MIS 
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information  type  and  the  MIS  PROCESSES  is  identified  in  the 
matrix  by  an  entry  value  (r,  u,  d,  a,  f,  1,  or  2)  at  the 
intersection  of  a row  and  column.  The  legend  of  these  entry 
values  is  presented  immediately  above  this  first  matrix  in 
the  report.  The  following  three  examples  demonstrate  how  to 
interpret  the  data  process  interaction  matrix  presented  in 
this  study  (Appendix  70).  As  seen  in  this  report,  the 
weekly-cost-updates  (GROUP,  row  24  or  i)  is  received  or  used 
by  the  MIS  generate-cf sr  function  (PROCESS,  column  11  or  j) 
according  to  the  entry  value  (r)  in  the  matrix  at  the 
intersection  of  the  row  (24)  and  column  (11),  page  70-7.  In 
addition,  this  same  GROUP  is  also  received  or  used  by  the  MIS 
generate-cpr  function  (PROCESS,  column  10  or  j).  A third 
example  is  the  current-cf sr-repor t-date  (ELEMENT,  row  31  or 
i)  which  is  updated  by  the  MIS  gener ate-cfsr  function 
(PROCESS,  column  11  or  j),  page  70-8. 

The  second  matrix  presented  by  the  data  process 

report  is  the  process  interaction  matrix  (incidence)  . This 

report  merely  shows  the  relationships  between  each  MIS 

PROCESS  (as  itemized  in  the  columns  of  the  first  matrix)  to 

all  other  PROCESSES  in  the  MIS.  (1)  In  this  square  formatted 

matrix  the  rows  and  columns  represent  all  MIS  PROCESSES. 

Where  an  asterisk (*)  appears  in  the  intersection  of  a row  and 

( 1)  Note:  This  implies  that- the  second  matrix  does  not 
indicate  all  the  relationships  between  the  MIS  PROCESSES,  but 
merely  those  which  are  exhibited  by  the  first  matrix. 

4-18 


column,  it  means  that  something  derived  or  updated  by  a 
PROCESS  on  the  side  of  the  matrix  (row  or  i)  is  used  by  a 
PROCESS  on  the  top  of  the  matrix  (column  or  j).  For 
instance,  something  derived  or  updated  by  the  input- 
processing-capabilities function  (PROCESS,  row  33  or  i)  is 
used  by  the  gener ate-networ k-data  function  (PROCESS,  column 
16  or  j),  page  70-20.  (1) 

4.3.5  MIS  Name  List  Report 

The  MIS  name  list  report  (Appendix  80)  is  the  final 
report  included  in  this  study.  This  report  merely  presents 
all  the  names  in  the  MIS  (data  types,  PROCESSES,  and  others) 
in  alphabetical  order.  This  report  is  easily  understood  by 
observing  the  name  list  included  in  Appendix  80. 


(!)  Note:  The  apparent  lack  of  information  contained  in  the 
MIS  interaction  matrix  (incidence)  contained  in  this  report 
is  due  to  the  generation  of  this  type  of  report  by  CADSAT  as 
described  in  the  previous  note. 
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SECTION  5 


SUMMARY  OF  RESULTS  and  RECOMMENDATIONS 

5.0  Introduction 

This  section  presents  a summary  of  conclusions  and 
recommendations  concerning  the  requirements  for  an  integrated 
MIS  for  ESD  program  offices. 

5.1  Summary  of  Results 

This  section  presents  a list  which  summarizes  the 
program  office  MIS  needs  relative  to  four  areas: 
cost/budgeting,  scheduling,  ECP  evaluation  and  control,  and 
plans  and  contract  preparation/control.  There  is 
considerable  overlap  between  these  areas,  as  should  be 
expected  in  an  integrated  information  system.  This  overlap 
is  evident  in  the  MIS  functional  requirements  presented  in 
section  4 and  the  appendices.  These  four  areas  are 
summarized  in  the  following  subsections. 

5.1.1  Cost/Budgeting:  program  offices  and  ESD  staff  offices 
emphasized  the  following  cost  and  budgeting  needs: 

- developing  a standardized  cost  estimating  process 
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- generating  realistic  life  cycle  cost  models 

- generating  the  annual  budget  call  submissions 

- determining  the  status  of  project  cost  (tracking 
cost) 

- determining  the  cost  impacts  of  requirement  changes 
and  performance  deviation  (e.g.,  projected  cost 
adjustments,  loss  of  funds,  underruns,  overruns) 

- projecting  future  cost  problems  from  analysis  of 
available  information 

- receiving  accurate  and  timely  cost  expenditures 
(labor  hour  expenditures) 

- developing  standard  terminology  between  various 
system  acquisitions  regarding  cost  preparation  and 
reporting 


5.1.2  Scheduling:  Program  offices  and  ESD  staff  offices 
emphasized  the  following  scheduling  needs: 

- developing  a standardized  schedule  estimating 
process 

- determining  the  status/progress  of  the  project 

- determining  schedule  adjustments  resulting  from 
requirement  changes  and  performance  deviation. 

- projecting  future  schedule  problems  from  analysis 
of  all  available  data 

- developing  standard  schedule  terminology  across 
similar  system  acquisitions 

5.1.3  ECP  Evaluation  and  Control:  Program  offices 
emphasized  the  following  ECP  needs: 
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- determining  the  impacts  of  ECPs  on  system 
requirements 

- determining  the  status  of  all  ECPs  in  the  program 
office  ( ECP  tracking) 


5.1.4  Plans  and  Contract  Preparation/Control:  Program 
offices  and  ESD  staff  offices  emphasized  the  following 
planning  and  contract  preparation  needs: 

- developing  a standardized  approach  for  defining  the 
functional  and  component  breakouts  of  systems 

- developing  a means  of  assessing  the  impacts  of 
requirements  changes  to  established  plans  and 
documents  (Specifications,  etc) 

- developing  a means  of  identifying  the 
inconsistencies  and  incompleteness  of  the  system 
requirements 

- ability  to  produce  plans  and  contract  documents  in 
a timely  manner  (clerical  functions) 


5.2  Recommendations 


5.2.1  Automate  a Standardized  Cost  Method 


A consistent  analytical  methodology  to  forecast 
financial  requirements  of  a system  is  needed.  This  process 
can  best  be  accomplished  by  automating  certain  aspects  of  the 
cost  estimating  and  budgeting  activities,  and  integrating  the 
information  into  a program  office  MIS  which  would  be 
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responsive  to  the  unique  requirements  of  each  acquisition, 
the  program  office  personnel , and  the  external  informational 
needs  of  concerned  commands  and  staff  agencies. 

5.2.2  Provide  ECP  Support 

Although  an  MIS  cannot  replace  the  technical 
evaluation  of  an  ECP  by  the  analyst,  certain  features  of  an 
automated  system  can  facilitate  other  activities  associated 
with  the  ECP  evaluation  and  approval  cycle.  These  features 
are  the  ability  to  maintain  accurate  tracking  histories  or 
records  of  ECPs  handled  by  the  program  office  and  the  ability 
to  do  impact  analysis  of  an  ECP  relative  to  the  systems 
requirements  definition. 

5.2.3  Provide  Management  Tracking 

There  is  a general  need  for  many  other  automated 
tracking  features  within  the  program  office.  In  addition  to 
the  ECP  tracking  function,  there  are  requirements  for 
maintaining  records,  and  reporting  on  a variety  of  subjects: 

- Manpower  planning,  control  (manpower-schedule) 

- Project  scheduling,  control  (milestone-schedule 
and  network-chart) 

- Deliverables  scheduling,  control,  reporting 
(cdrl-schedule) 
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ECP  evaluation,  control,  reporting 
(ecp-impact-analysis  and  ecp-status) 

- System  requirements  analysis 

- Text  processing,  contract  document  preparation 

5.2.4  Pursue  a Prototype  Application 

In  order  to  proceed  beyond  this  study,  it  is 
recommended  that  some  prototype  application  be  pursued  with  a 
single  ESD  program  office.  A prime  target  for  this 
prototyping  would  be  the  E-3A  program  office  which  is  one  of 
the  largest  acquisitions  currently  employing  several  MIS 
functions:  weekly  cost  estimating,  CDRL  tracking,  and  data 

access  by  the  contractor. 

5.2.5  Need  for  Joint  Involvement 

Finally,  the  need  for  an  integrated  MIS  at  ESD  is 
closely  tied  to  the  activities  of  the  program  office  and  the 
requirements  peculiar  to  the  ESD  method  of  system 
acquisition.  The  successful  application  of  any  integrated 
MIS  will  depend  on  the  interest  and  capabilities  of  an  ESD 
support  agency  or  contractor  in  establishing  a prototype  MIS. 
The  involvement  of  a staff  office  would  facilitate  the 
applications  of  the  MIS  to  other  program  offices,  and  remove 
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PROGRAM  UFFICE  INTERVIEW  GUIDELINE 

1.  What  are  the  primary  SPO  Director  decisions? 

o Criticality 
o Frequency 

o Desirability  of  more  or  better  information 

2.  What  reports/reporting  currently  supports  each  decision 
in  item  1,  if  any? 

o Formal 

o Informa] 

o Internal 

o External 

o Basis  for  requirement  (AFK,  etc.) 

3.  how  is  each  item  in  2 reported? 

o Detail 
o Summary 

o Hard  Copy  (standard  form,  letter) 
o Verbal  (briefings) 

4.  when  is  each  item  in  2 reported? 

o Daily 
o Monthly 
o Quarterly 
o Annually 

5.  Who  is  each  item  in  2 reported  to? 

6.  What  is  the  input  for  each  item  in  2? 
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7.  what  is  the  source  of  input  for  each  item  in  2? 

o Contractor 
o spo 

O other  (AFSC,  TUST,  ACE , ROC,  PMD,  OEP,  etc.) 

8.  in  what  form  is  each  input  originally? 

o Detail 
o Summary 

o Hard  Copy  (Status  Report) 
o Verbal  (briefings) 

9.  At  what  level (s)  in  the  decision-making  process  is  the 
information  used? 

1M.  What  is  the  disposition  of  each  item  in  6 aj  cer  the 
reporting  requirement,  for  which  it  is  used  is  fulfilled? 

o Disposed  of,  how? 

o Filed 

\ -In  what  form? 

-how,  if  form  of  the  information  changes? 

-how  long  is  this  specified  in  the  authority  to 
be  identified  in  question  1? 

11.  which  items  in  2,  if  any,  are  automated? 

o how  much? 
o Where? 

o Turn-around  (from  information  query  to  system 
generated  results) ? 

o Is  it  used? 

12.  Which  items  in  6,  if  any,  are  automated? 

o How  much? 
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o Where? 

o Turn-around  (from  information  query  to  system 
generated  results)? 

o Is  it  used? 

13.  which  items  in  2 require  the  most  manpower  to  generate? 

o Estimated  manpower  (manhours,  computer-time)? 
o . Why? 

1 4 . Does  the  SPO  have  a requirement  for  one-time  information 
requests? 

o how  many? 

o How  often? 

o how  fast? 

o What  type  (information  retrieval , with 
cal cul ations , with  formatting)? 

15.  what  turn-around  times,  from  query  to  system  generated 
results,  would  be  considered  the  limits  of  the  following 
categories? 

o Excellent 

o Good 

o Fair 

o Poor 

o Useless 

16.  what  other  SPO  information  management  tasks  not  covered 
in  2 to  15  would  be  of  help  if  automated? 

o Answer  2 to  1 3 for  each 

17.  What  information  is  reported  or  should  be  reported 
downward  to  the  SPO? 

o Answer  2 to  13  for  each 
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APPENDIX  20 


ESD  STAFF  OFFICE  INTERVIEWS 


20.0  Discussions  were  held  with  the  Directorate  of 
Acquisition  Support,  Technical  Integration  Division  (TOST) 
and  four  offices  within  the  comptroller's  office  (AC). 


2u.l  One  of  TOST's  primary  concerns  is  minimizing  life  cycle 
costs.  Part  of  this  concern  is  an  effort  to  increase 
management  visibility  across  the  life  cycle,  standardize 
information  reporting,  and  increase  the  utility  of 
information  collected.  TOST's  official  charter  is  as 
follows: 


Serves  as  staff  OPR  in  the  areas  of 
reliability,  maintainability,  availability, 
system/cost  effectiveness,  micro-electronics, 
quality  assurance,  configuration  management, 
systems  analysis,  human  factors,  value 
engineering,  engineering  design  reviews, 
computer  programs  acquisition  management, 
system  engineering  management,  test  and 
evaluation,  corrosion  control,  nondestructive 
inspection/testing , survivability/ 
vulnerability,  electromagnetic  compatibility, 
and  for  laboratory  support  to  ESD  program 
offices . 

TOST  emphasized  the  development  of  standardization  of 
information  across  the  lines  of  management.  At  least  four 
commands  are  involved  in  the  development  and  operations  of 
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Air  force  systems.  These  are  the  implementing,  operating 
(user),  training  and  logistics  (supporting-maintenance) 
commands.  wnile  intra-command  communications  is  improved  by 
tne  usage  of  liaison  personnel,  further  improvements  could  be 
made  by  standardizing  tne  terminology  and  processing  of 
management  information  between  the  commands. 


From  TOST's  point  of  view  the  information  areas  of  special 
concern  are  as  follows: 


o Standardization  of  terminology,  Automated  Data 
Processing  data  elements  and  computer  programs  for 
similar  systems  in  order  to  enable  collection  and 
comparison  of  cost/schedule  data. 

o Common  hierarchies  for  operational  requirements, 
system  hardware/parts,  system  software  (Computer 
Program  Configuration  Items),  functional  specialties 
(work  Breakdown  Structure,  engineering  specification 
trees,  configuration/engineering  change  proposal 
accounting,  work  unit  codes,  parts  breakdown  and 
provisioning  lists). 

o Development  of  efficient,  user-oriented  optimum 
repair  level  analysis  and  logistics  support  analysis 
computer  programs 

o Development  of  realistic  life  cycle  cost  models 


20.2  Within  the  Comptroller's  Office  the  two  divisions  and 
four  offices  which  were  interviewed  have  the  following 
official  charters: 


o Programs/Budget  Division  (ACB) : ACBB  is 
responsible  for  (1)  the  centralized 
direction,  policy  guidance,  and 
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administration  of  the  ESD  budget  formulation 
and  execution,  and  (2)'  the  £SD  program  to 
enhance  the  quality  and  performance  of  the 
people  working  in  Business  Management. 

o Program  Management  Support  Branch  (ACBB) : 
Serves  as  the  focal  point  for  policies  and 
procedures  affecting  Business  Management 
Office  activities  and  organization.  Plans, 
organizes,  and  administers  the  BSD  training 
program  for  enhancing  the  quality  and 
performance  of  Business  Management  personnel . 
Conducts  Staff  Assistance  Visits  to  Business 
Management  Offices  to  improve  management 
practices,  solve  procedural  problems,  and 
promote  a "lessons  learned"  crossfeed  within 
BSD.  Provides  technical  assistance  in  such 
areas  as  scheduling  and  documentation, 
supports  the  Resource  Utilization  Committee 
(KUC) , and  serves  as  the  Secretariat  for  the 
Business  Management  Board.  Works  closely  and 
in  coordination  with  the  Financial  Management 
Branch  to  insure  that  the  assistance  being 
provided  to  Business  Management  Offices  is 
responsive  to  the  requirements  of  the  budget 
formulation  and  execution  process. 

o Financial  Management  Branch  (ACSF) 
Formulated,  justifies,  and  monitors  the 
execution  of  the  ESD  RDT&E,  Aircraft 
Procurement,  and  Other  Procurement 
Appropriations  budgets.  Serves  as  the  focal 
point  for  the  policies  and  procedures  for 
financing  the  development  and  acquisition 
programs.  Analyzes  and  reports  financial 
trends,  problems  and  financing  proposals. 
Responsible  for  the  Program  Objective 
Memorandum,  Annual  Call  (Budget  Update),  and 
presentations  for  the  Hq  USAF-Hq  AFSC  Program 
Financial  Reviews  and  the  ESD  Business 
Management  Board. 

o Cost  Analysis  Division  (ACC):  Responsible 
for  preparation  of  immediate  and  long  range 
estimates  of  development,  investment  and 
operating  costs  in  terms  of  programs  and 
systems.  Develops  plans,  programs,  and 
schedules  for  the  collection,  validation,  and 
analysis  of  cost  data.  Manage  the  Cost  and 
Economic  Aid  Information  System.  Extends 
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technical  cost  estimating  assistance  to  all 
System  program  Offices,  and  participates  in 
special  cost  studies  parametric  and  economic 
analysis,  and  source  selection  evaluation 
studies.  Assists  with  the  development  and 
implementation  of  Command  policy  for  the 
Cost/Schedule  Control  Systems  Criteria 
(C/SCSC)  programs.  Maintains  the  Selected 
Acquisition  Information  System. 

o Cost  Estimating  and  Analysis  Branch 
(ACCE) : Determines  and  validates  resource 

implications  of  alternative  courses  of  action 
through  preparation,  evaluation,  and 
documentation  of  total  cost  and  resources 
studies  in  support  of  planning,  programming, 
and  budgeting  functions.  Prepares  resource 
estimates  to  support  planning  before  the 
Systems  Program  Office  (SPO)  has  been 
established,  provides  technical  cost 
estimating  assistance  for  established  SPOs 
and  cost  analysis  of  selected  ongoing 
programs.  Validates  and  prepares 
recommendations  concerning  the  adequacy  of 
the  data  base  methodology,  documentation  of 
estimates  forwarded  to  higher  echelons. 
Prepares  independent  cost  estimates, 
participates  in  special  cost  studies  and 
source  selection  activities  as  required. 
Maintains  program/project  continuity  through 
functional  alignment  of  cost  estimating 
groups . 

o Cost  Management  Systems  (ACCI):  Supports 
cost  estimating  requirements  through  data 
analysis  and  development  of  generalized  cost 
estimating  relationships,  cost  factors, 
learning  curves,  price  and  wage  indices,  and 
specific  program  studies.  Conducts  research, 
develops  new  or  modified  existing  cost 
information  and  data  systems,  including 
mathematical  models,  other  computerized 
systems  and  tools,  data  plans  and  work 
breakdown  structures.  Provides  analysis  of 
cost  information  at  established  milestones  in 
the  program  life  of  selected  on-going 
programs  and  acts  as  focal  point  for  estimate 
tracking  program.  Reviews  procurement 
packages  for  financial  management 
requirements  in  conjunction  with  the  Cost 


Estimating  and  Analysis  Branch.  Collects, 
classifies,  stores  and  retrieves  historical 
cost  data,  including  SAIMS,  data,  proposal 
and  other  cost  reports.  Provides  Cost 
Library  service  to  LSD,  other  AF  Commands, 
and  other  DOD  agencies.  provides  focal  point 
for  SAIMS,  to  include  Cost  information 
Reports  (CIR)  and  contractor  performance 
measurement  activities.  Provides  support  to 
SPQs  and  division  staff  in  the 
implementation,  evaluation,  and  validation  of 
SAIMS,  C/SCSC,  MIL  STD  881  (WBS) , cost 
models,  and  other  computerized  cost 
estimating  or  information  system.  Develops, 
implements,  and  monitors  command  policy, 
procedures,  and  methods  for  Cost  Schedule 
Control  System  Criteria  (C/SCSC)  program 
policy,  procedures,  and  methods  for 
contractor  validation  exercises. 

Participates  in  the  command  program  to 
develop  systems,  tools  and  cost  methodology 
to  improve  the  efficiency  and  credibility  of 
AFSC 's  cost  analysis  capability. 

Participates  in  source  selection  activities 
as  required 


20.2.1  The  concerns  of  personnel  in  the  separate 
Comptroller's  Offices  were  similar.  Therefore,  the  results 
can  be  best  summarized  collectively  for  AC  rather  than 
individually.  From  AC's  point  of  view  the  specific 
management  information  concerns  for  program  offices  are: 

o Estimating 
o Scheduling 
o Budgeting 
o Planning 
o Analyzing 
o Forecasting 
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2U.2.1.1  First,  Estimating:  Estimates  form  the  basic 
foundation  upon  which  most  decisions  are  made.  Estimates 
become  more  important  when  they  form  the  basis  of  large 
resource  commitments.  Two  applicable  forms  of  estimating  are 
schedule  and  cost  estimating. 

- Schedule  estimating  is  the  expenditure  of  project 
resources  in  terms  of  time. 

- Cost  estimating  is  the  expenditure  of  project 
resources  in  dollars  and  cents. 

Most  estimating  is  currently  done  on  a manual  basis  by  each 
program  office  in  conjunction  with  the  AC  staff  offices.  To 
a great  degree  this  will  always  be  true.  However,  the 
difficulty  of  this  task  can  be  greatly  decreased  through  the 
use  of  automated  estimation  procedures.  The  estimating 
algorithms  used  by  AC  and  the  program  offices  should  be 
further  identified  and  analyzed  for  integration  into  a MIS. 
This  provides  several  benefits: 

- Decrease  in  program  office  estimating  work  load 

- Decrease  in  AC  staff  office  work  load 

- Better  understanding  between  program  offices  and 
the  AC  staff  office,  since  AC  will  be  using  the  same 
integrated  set  of  estimating  algorithms  tailored  to 
the  needs  of  the  particular  program  office. 
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2k).  2. 1.2  Second,  Scheduling:  Once  the  initial  estimates  are 
derived  as  described  above,  the  program  office  prepares  a 
program  scnedule.  During  the  pre-contract  phase  the  program 
office  updates  the  program  schedule  to  inc] ude  more  accurate 
and  pertinent  i formation.  In  most  acquisitions,  the  program 
office  includes  the  program  schedule  in  the  procurement 
package  for  the  contractors  review.  This  schedule  represents 
tne  governments  desires  or  requirements,  and  the  contractor 
prepares  his  schedule  for  government  review  and  approval 
« based  on  the  information  contained  in  the  governments 
pre-contract  schedule. 


2U.2.1.3  Third,  Budgeting:  It  is  extremely  difficult  to 
separate  the  activities  associated  with  scheduling  from  those 
of  budgeting.  The  schedule  is  theoretically  translated  into 
actual  cost  (budgeted  requirements)  of  the  human  and  material 
resources  necessary  to  accomplish  the  tasks  over  the  life  of 
the  acquisition  cycle,  however,  ESD  budget  requirements  are 
prepared  and  presented  in  annual  requirements  (slices)  from 
the  total  estimated  budget  requirements  which  usually  extend 
over  many  years  and  funding  allocations.  The  program 
direction  may  require  adjustment  to  reflect  authorized 
funding  or  changes  in  funding  allocations  as  determined  and 


' 
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directed  above  trie  ESD  level.  The  ESD  budgeting  process  is 
primarily  accomplished  on  a manual  basis  by  each  program 
office  with  assistance  from  the  comptroller's  office. 

Although  the  uniqueness  of  each  project  requires  the 
technical  input  from  the  program  office,  the  capability  to 
define  a budgeting  process  for  acquiring  and  assimilating 
budget  information,  and  the  generation  of  budget  reports  can 
be  accomplished  and  administered  by  a single  ESD 
organization.  This  method  has  been  an  established  approach 
in  private  industry  where  corporate  departments,  large  and 
small,  prepare  estimates  in  a prescribed  manner  and  submit 
the  information  for  inclusion  in  the  corporate  budget 
process.  In  many  instances  the  department  interactively 
updates  its  estimates  directly  into  corporate  computer  files 
which  also  provides  the  capability  for  automatically  allowing 
report  capabilities  at  many  levels  above  the  original  level 
of  the  updated  departmental  budget  estimates. 

2k). 2. 1.4  Fourth,  Planning:  The  initial  planning  activities 
of  estimating,  scheduling,  and  budgeting  are  accomplished  in 
the  early  conceptual  and  validation  phases  of  the  acquisition 
cycle  and  adjustments  to  these  issues  continues  throughout 
the  acquisition  cycle.  However,  when  these  time  and  money 
issues  are  approved,  the  planning  relative  to  the  system 
being  acquired  is  initiated.  Numerous  planning  documents  are 


20-8 


prepared  in  response  to  the  Program  Management  Directive 
(PMU)  ana  otner  directives.  some  of  these  are  the  Program 
Management  Plan  (PMP) , personnel  support  planning  documents, 
procurement  plan  (PP) , determinations  and  findings  (D&F)  , 
integrated  logistics  support  plan  (ILSP),  computer  resources 
integrated  support  plan  (CRISP),  environmental  assessments, 
test  and  engineering  master  plans  (TEMP),  request  for 
proposal  (RFP)  including  statements  of  work  and  system 
specifications,  and  source  selection  plans  and  source 
selection  criteria. 

The  entire  planning  function  associated  with  the  composite 
information  in  these  plans  constitutes  the  governments' 
intent  and  desires  in  the  acquisition  of  a system.  Since 
each  of  these  plans  are  developed  and  maintained  primarily  by 
manual  methods,  the  informational  threads  between  the  various 
plans  are  difficult  to  accurately  maintain.  An  impact  made 
in  one  planning  area  makes  a high  demand  of  program  office 
resources  to  analyze  and  adjust  associated  plans,  briefings, 
and  documentation. 

2U.2.1.5  Fifth,  Analyzing:  As  described  above  planning  is  a 
continuous  process  which  must  reflect  changes  necessitated  by 
events,  and  the  program  office  must  constantly  respond  to 
external  events  which  are  a results  of  governmental  and 


2k)-9 


contractor  initiated  inquiries  or  impacts  during  the  system 
acquisition  process.  The  program  office  must  perform  various 
studies  on  an  on-going  basis  in  order  to  monitor  the 
acquisition  process.  In  addition,  the  program  office  must 
assimilate  quantities  of  information  from  the  contractor. 

The  results  of  this  analyses  is  presented  in  various  reports, 
reviews,  and  presentations  made  to  the  program  manager  and 
higher  echelons.  Most  of  the  analysis  performed  by  the 
program  office  is  manual  and  many  types  of  automation  would 
be  greatly  useful  in  this  area.  These  include  rather  simple 
cross  referencing  computer  programs  for  the  WBS,  CPR,  CFSR, 
and  CIK  to  much  more  complex  computer  programs  with  analysis 
and  alternative  algorithms  for  resource  scheduling  and 
allocation . 

20.2.1.6  Finally,  Forecasting:  Not  only  must  the  current 
status  of  a projects  progress  be  ascertained  by  various 
analysis  activities,  but  also  forecast  must  be  made  of  the 
future  status  of  the  project.  Early  problem  recognition  and 
reporting  and  tradeoff  analysis  allow  the  program  office  to 
make  the  necessary  adjustments  and  reduce  risks  which  could 
impact  the  progress  of  the  project.  As  is  true  with 
analysis,  this  is  mostly  a manual  task;  this  work  could  be 
aided  by  many  automated  tools.  Any  automation  in  the 
financial  areas  would  ultimately  aid  in  forecasting. 

20-10 


APPENDIX  3k) 


LSD  PROGRAM  OFFICE  INTERVIEWS 

3k). u.  Discussions  were  held  with  four  LSD  Program  Offices: 
uCn/TKACALS,  OCL/PAVE  PAWS,  DCV/SATIN  IV,  and  YW/E-3A.  This 
appendix  details  the  concerns  of  each  program  office 
interviewed . 

3U.1  OCn/'I'KACALS  (Traffic  Control  Approach  and  Landing 
Systems) 


TRACALS  is  a multi-project  office  (basket  program 
office)  with  12  major  projects  and  is  managed  by  a single 
program  office  director.  Each  project  is  headed  by  a 
program  manager  and  many  are  projects  in  the  multi-million 
dollar  category.  Most  of  the  contracts  are  fixed  price 
incentive  and  one  is  a level  of  effort  contract.  The  OCN 
program  director's  main  concern  is  the  timeliness  of  cost 
data.  Cost  information  such  as  the  CPR  runs  almost  two 
months  behind  the  real  events.  This  needs  to  be  changed  so 
that  cost  data  is  received  by  the  program  director  within  two 
weeks  of  the  actual  end  of  the  month.  Technical  problems, 
however,  need  to  be  reported  within  two  days  of  the  problems 
observance . 
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A secondary  concern  that  the  TRACALS  program 


director  experiences  is  the  impact  of  engineering  change 
proposals  (ECPs) . ECPs  occur  about  twice  a week  and  require 
an  analysis  and  response  to  several  important  issues  within, 
approximately  thirty  days.  Questions  of  primary  concern  are: 

o Does  the  ECP  constitute  a change  in  scope? 

o Is  the  ECP  cost  and  time  effective? 

o how  does  the  proposed  change  benefit  the 
government? 


Similarly,  when  a new  requirement  is  levied  on  a program 
office  there  seems  to  be  little  anticipation  of  the  impact, 
on  the  current  system  requirements.  In  order  to  assess  the 
impact  an  evaluation  of  the  task  and  budget  has  to  be 
performed  to  determine  if  the  change  can  be  made  without 
impacting  the  requirements  of  existing  resources.  If  the 
impact  can  not  be  absorbed  by  existing  resources,  additional 
resources  must  be  defined  and  accommodations  made  to  the 
acquisition  process.  Although  there  is  no  require  *nt  to 
report  change  statistics,  a ca'pability  to  track  the  history 
of  all  changes  to  the  requirements  would  facilitate  the  ECP 
change  evaluation  and  change  procedures.  At  present 
configuration  control  is  primarily  a manual  process  and  each 
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program  within  the  TkACALS  program  office  has  one  or  more 
conf igur ation  managers  who  perform  this  task  on  a full  or 
part  time  oasis  as  required.  A requirement  that  is  rather 
unique  to  a basket  type  program  office  is  the  continuous 
generation  or  procurement  specifications  which  is 
accomplishea  in  OCN  about  twice  a year.  A single  procurement 
must  be  supported  by  two  full  time  typists  for  a period  of 
about  tnree  montns  and  may  incorporate  as  many  as  five  or  six 
revisions. 

3tf.  2 OCL/PAVE  paws  (Phased  Array  Warning  System) 

PAVE  PAWS  is  a single  48  month  procurement 
requiring  the  coordination  of  both  military  and  non-military 
support  agencies.  Again,  the  program  director's  main  concern 
is  the  timeliness  of  cost  data.  Information  in  the  CPRs  and 
tne  CFSKs  runs  at  least  thirty  days  behind  the  real  events 
and  is  practically  outdated.  The  currency  of  the  reports 
needs  improvement.  PAVE  PAWS  experiences  difficulty  in 
knowing  the  status  of  the  funds  and  schedules  relative  to 
governmental  support  agencies  involved  in  the  acquisition. 

The  status  of  the  disposition  of  funds  as  allocated  by 
various  agencies  is  practically  non-existant . There  is  a 
real  need  for  timely  reporting  by  all  support  agencies 
outside  the  jurisdiction  of  the  program  office. 
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Informational  support  should  be  achieved  along  a similar 
oasis  to  that  of  the  reporting  requirements  of  esd 
contractors.  This  would  allow  the  program  office  which  is 
responsiole  for  monitoring  funds  expenditures  and  schedules 
the  ability  to  receive  all  the  necessary  information  to 
accurately  assess  the  program  status. 

A secondary  concern  of  the  PAVE  PAWS  program 
director  is  handling  engineering  change  proposals.  ECPs 
have  occurred  at  a rate  of  two  per  month  over  the  past 
fourteen  month  period  and  have  been  increasing  at  a rate  of 
two  or  three  a month  over  the  past  six  months.  This  trend  is 
expected  to  continue  for  another  six  months.  Each  ECP 
requires  the  support  of  ten  PAVE  PAWS  specialist  over  a 
thirty  day  period.  A program  office  configuration  manager, 
one  cost  manager,  and  eight  technicians  are  involved  in  each 
ECP  action.  This  task  group  must  address  the  following 
issues  for  each  ECP: 

o Does  the  ECP  constitute  a change  in  scope? 
o Is  it  a change  to  a necessary  system  requirement? 

o Will  it  result  in  a cost  and/or  schedule  impact? 

o Will  it  result  in  a system  performance  impact? 

o Was  the  original  system  requirement  not  feasible? 


30-4 


3a. 3 DC  V/ SATIN  IV  (SAC  Automated  Total  Information  Network) 


SATIN  IV  is  a program  for  developing  an  integrated 
SAC  command-wide  digital  record  communications  system  to  meet 
Sac's  requirements  for  command-control  and  support  data 
transmission  into  the  1990s.  A primary  concern  of  the 
program  office  director  is  in  trying  to  balance  actual  cost 
and  schedules  witn  budget  allocations.  His  major  endeavor  is 
to  Keep  the  funding  for  each  fiscal  year  in  line  with  the 
allocated  budget.  In  order  to  accomplish  this  task  he  must 
also  plan  for  possible  budget  cuts,  be  prepared  to  assess  the 
impact,  and  provide  for  program  adjustments  as  necessary. 
Another  important  part  of  his  job  is  preparing  and 
presenting  numerous  briefings  for  higher  reviews.  Again,  a 
major  problem  is  the  timeliness  of  contractor  information 
(CPRs)  . This  information  needs  to  be  available  on  a weekly 
basis  to  tne  program  office.  It  must  detail  the  contractor's 
man  hour  expenditures. 

Another  major  concern  of  the  program  director  is 
engineering  change  proposals.  ECP  analysis  is,  as  was  true 
for  PAVE  PAWS,  a very  complex  process,  since  each  ECP  must  be 
evaluated  against  all  program  functions  and  often  impacts 
anotner  government  agency.  In  addition,  this  program  office 
has  a need  and  has  developed  an  in-house  capability  to  trace 
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requirements,  not  only  back  ta  the  system  specification,  but 
all  the  way  back  to  the  documents  whicn  describe  the 
requirements.  This  capability  is  significant  in  evaluating 
the  impact  of  each  ECP. 

3w.  4 YW/E— 3A  AWACS  (Airborne  Warning  and  Control  Systems) 

AWACS  is  a multi-billion  dollar  program  to  provide 
a survivable  airborne  air  surveillance  capability  and 
command,  control  and  communications  functions.  There  are 
some  1 4 W program  office  personnel  and  some  45  MITRE  personnel 
augmenting  the  program  office  resources.  The  E-3A  aircraft 
has  been  in  the  production  phase  for  some  time.  Cost, 
schedules  and  the  timeliness  of  information  are  again  the 
major  issues  which  concern  the  AWACS  program  office  director. 
In  a program  office  the  size  of  AWACS,  production  phase 
information  on  cost  and  schedules  must  be  acquired  and 
analyzed  in  a timely  manner. 

First,  Costs:  Timely  cost  information  is  needed  on 
a weekly  basis.  The  CPR  system  was  built  for  E-3A  by  MITRE 
and  there  was  no  history  or  trend  analysis  in  the  original 
version.  The  statistical  algorithm  to  forecast  the  bottom 
line  has  also  been  changed.  However,  the  E-3A  CPR  system  has 
more  error  checks  than  the  base  version  and  has  the 
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capability  of  doing  computer  generated  graphics  using  CALCOMP 
plotters.  The  CPR  comes  from  the  contractor  broken  down 
functionally  by  WBS.  The  CPR  system  does  not  do  any  analysis 
of  costs  based  on  indices,  i.e.  analysis  of  the  cost 
performance  index  and  schedule  performance  index.  A 
functional  flow  of  the  E-3A's  current  CPR  system  is 
illustrated  in  Figure  30-1. 

Second,  Schedule:  Schedules  should  be  tracked 
simply  and  concisely  so  projected  problem  areas  can  be 
addressed  before  they  cause  schedule  slips.  At  present,  E-3A 
is  using  a government  owned  data  base  management  system 
(VENUS)  for  data  manipulation  of  a milestone  data  base.  The 
milestones  and  schedule  data  comes  from  the  contractor  as  a 
data  item  deliverable  on  a monthly  basis  and  the  information 
is  entered  into  the  VENUS  data  base.  The  analysis  sections 
and  report  generation  capabilities  are  augmented  with  program 
office  developed  FORTRAN  programs.  The  system  is  used  mainly 
in  the  batch  (over-the-counter)  mode.  The  prime  contractor 
is  now  using  the  data  base  through  an  interactive  terminal. 

Of  the  some  2000  milestones  in  the  VENUS  data  base, 
about  65  to  843  milestones  are  processed  each  week.  Of  these 
44)  to  54)  are  revisions  indicating  overdue  deliverable  and  25 
to  44)  are  new  deliverable  milestones  which  are  to  be  entered. 
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Figure  30-1.  E-3A  CPR  System,  Functional  FI 


Milestones  are  added  to  the  schedule  for  any  areas  of  high 
tecnnical  or  cost  risks.  A PERT  type  network  was  used  for 
tne  first  E-3A.  Presently  Gantt  charts  by  V*BS  are  created  by 
the  program  office  from  the  VENUS  data  base  outputs. 

Turnaround  for  the  schedule  report  is  about  24 
hours,  due  to  computer  time  scheduling  and  partially  due  to 
tne  inability  for  VENUS  to  produce  a long  series  of  reports 
quickly.  VENUS  was  developed  for  laboratory  use  and  does  not 
include  tne  processing  options  or  documentation  to  be  useful 
beyond  its  current  use  by  the  AWACS  program  office.  In 
general  it  is  a simple  query  and  update  system  and  its 
marginal  documentation  makes  it  difficult  for  training 
purposes . 


The  program  director's  second  concern  is 
engineering  change  proposals.  ECPs  occur  at  a rate  of  three 
to  six  a week.  Engineering  change  proposals,  changes  in  user 
requirements,  and  contractor  performance  monitoring  must  be 
managed  on  a strict  basis.  This  process  is  accomplished 
primarily  on  a manual  basis  and  ensures  that  the  system  will 
meet  the  performance  specifications  within  the  proposed  cost. 
Configuration  Control  coordinates  the  analysis  and  review 
process  of  ECPs  to  ensure  completeness  in  the  analysis  and 
review  as  accomplished  by  program  office  and  MITRE  technical 
staff . 
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A P P E N Li  I X 9«i 


SELECTED  SlBLlUGKAPny 
(CADSAT  GENERATED) 


1 entity 

2 synonyms  are: 

3 Keywords: 

4 

5 


9 f e-docs ; 
documents , 
gre  ; 


Get ; 


/ 

8 

9 

la 

11 

12 

13 

1 4 

15 


* / 
18 
2a 
21 
22 

23 

24 

25 

26 
27 
23 
29 
3a 

31 

32 

33 

34 


group  GFE-documen ts 

synonyms  are:  g f e-documents ; 
description ; 

This  is  a CADSAT  listing  of  all  Government 
Equipment  (GFE)  for  the  CADSAT/MIS  contract,  in 
circumstance  a list  of  GFE  documents; 

Keywords:  documents, 

gfe; 

consists  of: 

AD  7 a 1 3 a 3 , 

AD7S4926 , 

ADAal  173a , 

AD  7 6 5 2 a 3 , 

ADA  a 1 6 4 5 2 , 

AD7673a6, 

AD  7 3 5 2 1 a , 

AD736987 , 

AD877476L, 

AD766a92 , 

AD735143 , 

AD783544 , 

AD787704 , 

ADAaa6334 , 

AD7  8 1 74  9 , 

ADBaa  53a oL , 

AD3Ua8a75, 

ADBa 1 a 2 46L ; 


Furnished 
tni  s 


35  element  AD7al3U3; 

36  synonyms  are:  ad7al3a3; 

37  description; 

38  Application  and  Demonstration  of  NAS  Saufley  Manpower 

39  Allocation  and  Productivity  Measurement  Model; 

4a  Keywords:  documents, 

4 1 gfe ; 

42  contained  in:  GFE-documen ts ; 


9a-l 


1 


43 

44 

el  enter. c 

AD784926 ; 

4b 

synonyms  are: 

ad 784525  ; 

4b 

description ; 

47 

Representation  of  Information  in  the  Design-Construct: 

4b 

Process ; 

49 

Keywords : 

documents , 

5 a 

gfe; 

51 

52 

contained  in: 

GFE-documents ; 

53 

el emen  t 

ADAU 1 1 73  U ; 

54 

synonyms  are: 

aday 1 173tf ; 

55 

description ; 

56 

Experimental  Interim  RADC  MIS  System  (FEMIS); 

57 

Keywords : 

documents , 

58 

gfe; 

59 

6a 

contained  in: 

GFE-documents ; 

61 

element 

AD7o  5 2k)  3 ; 

6 2 

synonyms  are: 

ad 76  5 2k)  3 ; 

63 

description ; 

6 4 

General  i 

zed  Data  Base  Management  System  and  Selected 

o 5 

Air  force  Applications; 

66 

Keywords : 

documents , 

67 

gfe ; 

6b 

69 

contained  in: 

GFE-documents ; 

7d 

element 

AD875H35; 

71 

synonyms  are: 

ad  8 7 5 d 3 6 ; 

72 

description ; 

73 

Descript 

ion  of  the  SACCS  Data  Management  System; 

74 

Keywords : 

documents , 

75 

gfe; 

76 

contained  in: 

GFE-documents ; 

77 

security  is: 

l’OIT, 

78 

79 

C. Hartman ; 

8a 

element 

ADAtf 16452; 

81 

synonyms  are: 

adati  164  52  ; 

82 

description; 

83 

Concept 

of  a Management  Information  System  for  TESPC; 

84 

Keywords : 

documents , 

85 

gfe; 

36 

contained  in: 

GFE-documents ; 

9U-2 


8'’ 

6 o 

el ement 

AC"6',3; 

b a 

syno  nyms 

aro  ; 

ad  7 6 7 3 iu  5 ; 

9u 

descripti 

on  ; 

91 

Program 

and  Financial  Management  p] 

92 

Systems . 

Volume  IV.  NUsC  P E KT/T IM fc/CuST 

93 

Keywords : 

documents , 

94 

gfe  ; 

95 

contained 

in : 

GFt-documents ; 

96 

97 

element 

AD7352 

93 

synonyms 

are : 

ad  736  210 ; 

99 

description ; 

UU 

use 

of 

Edit  Information  to  Measure  , 

Content  in  a MIS; 

Keywords;  documents, 

gfe ; 

contained  in:  GFE-documents ; 


element  AD73698’’; 

synonyms  are:  ad?36937; 
description ; 

MIS  Techno] ogy:  A view  of  the  Future; 
Keywords:  documents, 

gfe ; 

contained  in:  GFE-documents  ; 


element  AD87747oL; 

synonyms  are:  AD3774751, 
ad877476L, 
ad  877476] ; 

description ; 

The  Army  Communications-Electronics  Management  Informatio: 
System  (ACEMIS)  -Coordination  Draft-  Master  DeveJoprnent  Plan 
Volume  I.  Executive  Summary 

— Two  copies  of  this  manual  were  acquired 
rather  than  a copy  of  manual  AD877476 
App] ication  and  Demonstration  of  NAS  Saufley  Manpower 
Allocation  and  Productivity  Measurement  Model ; 

Keywords:  documents, 

gfe ; 

contained  in:  GFE-documents; 

security  is:  TOIT, 

C. Hartman; 


90-3 


1 

element 

AD766392; 

lib 

synonyms  are: 

ad  7 6 6 y 9 2 ; 

134 

description ; 

135 

Imp] emen 

tation  of  Comple 

;<  Management  Information  Systems; 

136 

Keywords : 

documents , 

lb? 

gfe; 

13S 

contained  in: 

GF  t-documen ts ; 

139 

1 4 u 

el ement 

AD?  8 514  3; 

1.4  1 

synonyms  are: 

ad  7 8 5 1 4 3 ; 

142 

description ; 

U3 

Feasibil 

ity  and  Util ity 

of  an  on-line  Information 

1 4 4 

Communications  System  in  a Research  and  Development  Management 

145 

and  Pi anning 

Environment ; 

146 

Keywo  rds : 

documents , 

U7 

gfe; 

148 

contained  in: 

GFE-documents ; 

149 

150 

el ement 

AD733544; 

151 

synonyms  are: 

ad  7 8 3 54  4 ; 

152 

description ; 

153 

Appl icat 

ion  of  a Process 

Model  to  a Management  Support  System 

1 54 

Keywords: 

documents , 

155 

gfe ; 

1 56 

contained  in: 

GFE-documents ; 

15? 

158 

element 

AD787704 ; 

159 

synonyms  are: 

ad  7 8 77y 4; 

1 60 

description ; 

lb  1 

An  Analysis  of  Program  Evaluation  and  Review  Technique  (PERT) 

162 

in  Weapon  System  Acquisition; 

163 

Keywords : 

documents , 

164 

gfe; 

165 

contained  in: 

GFE-documents; 

166 

167 

element 

ADAO  0 6 3 3 4 ; 

168 

synonyms  are: 

adaldk)6  334 ; 

169 

description ; 

170 

An  Evaluation  of  the  Integrated  Managerial  Programing  Analys- 

171 

and  Control  Technique  System 

(IMPACT)  of  the  Aeronautical  Systems 

172 

Division  (AFSC)  — A Management  Information  System; 

173 

Keywords : 

documents , 

174 

gfe; 

175 

contained  in: 

GFE-documents ; 

176 

% 

90—4 


r 


17? 

el  ement 

AD73 1 "’4  9 ; 

178 

synonyms  are: 

ad  7 8 1 ’’  4 9 ; 

179 

description ; 

18a 

Technical  Literature  Review  Concerning  Management  Informati 

131 

Systems ; 

132 

Keywords : 

documents , 

183 

gfe; 

184 

contained  in: 

GFE-documents ; 

185 

135 

el ement 

ADB4J  43  53  43  5L ; 

187 

synonyms  are: 

ADB  43  4J  53061  , 

183 

adbtJU  53y  6L, 

139 

adt>043  5343  61  ; 

19a 

description; 

191 

Implementation  of  United  States  Air  Force  Automatic 

192 

Data  Processi 

ng  Requirements  Studies  - A Management 

193 

Dilemma ; 

194 

Keywords : 

documents , 

195 

gfe ; 

195 

contained  in: 

GFE-documents ; 

197 

security  is: 

TO  IT, 

198 

C . Hartman ; 

199 

2a  a 

element 

ADBB  43  8 4J75; 

2a  1 

synonyms  are: 

adbtf'J  8u  7 5 ; 

2a  2 

description ; 

2a3 

DR£V  Management  Information  System; 

2a4 

Keywords : 

documents , 

2a5 

gfe ; 

2a  5 

contained  in: 

GFE-documents ; 

2U7 

2a  8 

el  ement 

ADB43 1 4)  246L  ; 

2a9 

synonyms  are: 

ADB43  1 43  2 4 6 1 , 

21a 

adbkJ  143246L, 

211 

ad  bO  1 43  2461  ; 

212 

description; 

213 

Army  Management  Information  Systems  Master  Plan  - 

21  4 

(AMIS  Master 

Pi  an)  ; 

215 

Keywords : 

documents , 

216 

gfe ; 

217 

contained  in: 

GFE-documents ; 

218 

security  is: 

TO  IT, 

219 

C . har tman ; 

9M-5 


